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AMENDMENTS TO THE CLAIMS: 

The listing of claims will replace all prior versions, and listings of claims in the 
application: 

LISTING OFCLAIMS: 

1 . (Currently amended) An image segmentation process comprising the 
following steps: 

a) segmenting an image into a main background, a first local background, 
and a first object, wherein the first object is on either the main background or the 
first local background; 

b) classifying the first object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object: 

c) if the first object is classified as a composite object, identifying a second 
local background for the first object: and 

d) segmenting a next object on the second local background . 

2. (Currently amended) The process set forth in claim 1 , step a) further 
comprising the following steps: 

b) i dentifying a ma i n background for tho imago; 

c) sogmonting a first objoct on tho main background; 

d) cla s s i fying the first object into ono class of a group of classes cons i sting of 
a toxt objoct, a picture object, and a compos i te objoct; 

e) i f tho first objoct i s classified a s a compos i te objoct, ident i fy i ng a local 
background for tho first objoct; 

f) sogmonting a next objoct on tho l ocal background; 

§f classifying the next object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object; and 

fb) if the next object is classified as a composite object, performing steps ce) 
through e§) for the next object. 

3. (Currently amended) The process set forth in claim 12, step ab) further 
comprising the following steps: 
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el) identifying one or more block of pixels in the image, wherein the dynamic 
ranges of each of the three color channels are less than a predetermined threshold 
for the block; 

f}) applying a region growing algorithm to each uniform block, wherein 
adjacent pixels with a color difference from the uniform block less than a 
predetermined threshold are marked as belonging to the region; 

gk) calculating a mean color for each grown region; 

hi) combining regions of similar mean color; and 

im) identifying the region with the largest bounding area as the main 
background for the image. 

4., (Currently amended) The process set forth in claim 12, step ae) further 
comprising the following steps: 

el) detecting edges in the main background in both vertical and horizontal 

directions; 

5) removing the edge pixels from the main background; 
gk) identifying a non-text object on the main background using a connect 
component analysis; and 

hi) segmenting the non-text object on the main background. 

5. (Currently amended) The process set forth in claim 12, wherein the 
first object is classified as a composite object, step ce) further comprising the 
following steps: 

ei) detecting edges in the first object; 

f}) removing the edge pixels from the first object; 

gk) applying a region growing algorithm to each pixel on the outer boundary 
of the removed edge pixels, wherein adjacent pixels with a color difference from the 
region less than a predetermined threshold are marked as belonging to the region; 
and 

hi) identifying the region with the largest bounding area; 
jm) comparing the dimensions of the largest region to a predetermined 
threshold; and 
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jn) if the dimensions of the largest region are greater than the predetermined 
threshold, identifying the region as the second local background for the first object, 
otherwise, reclassifying the first object as a picture object. 

6. (Currently amended) The process set forth in claim 2, steps df) and eg) 
further comprising the following steps: 

gt) applying a one-dimensional morphological algorithm to the second local 
background in the horizontal direction to segment the next object and classifying the 
next object as a text object if the width of the elements detected by the algorithm is 
less than a maximal width; and 

hj) applying a one-dimensional morphological algorithm to the second local 
background in the vertical direction to segment the next object and classifying the 
next object as a text object if the width of the elements detected by the algorithm is 
less than a maximal width. ■ . ' 

7. (Currently amended) The process set forth in claim 12, step df) further 
comprising the following steps: 

ei) detecting edges in the second local background in both vertical and 

horizontal directions; 

fj) removing the edge pixels from the second local background; and 

gk) segmenting the next object on the second local background using a 

connect component analysis. 

8. (Original) An image segmentation process, comprising the following 

steps: 

a) performing low-resolution segmentation of an image into a main 
background, a local background, and a first object, wherein the first object is on 
either the main background or the local background; and 

b) refining the borders shared by any two of the main background, the local 
background, and the first object at the original resolution of the image. 

9. (Original) The process set forth in claim 8, step a) further comprising 
the following steps: 

c) low-pass filtering and decimating the image; 
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d) identifying a main background for the image; 

e) segmenting a first object on the main background; 

f) classifying the first object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object; 

g) if the first object is classified as a composite object, identifying a local 
background for the first object; 

h) segmenting an next object on the local background; 

i) classifying the next object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object; and 

j) if the next object is classified as a composite object, performing steps g) 
through i) for the next object. 

10. (Original) The process set forth in claim 9, steps e) and f) further 
comprising the following steps: 

k) applying a one-dimensional morphological algorithm to the main 
background in the horizontal direction to segment the first object and classifying the 
first object as a text object if the width of the elements detected by the algorithm is 
less than a maximal width; and 

I) applying a one-dimensional morphological algorithm to the main 
background in the vertical direction to segment the first object and classifying the 
first object as a text object if the width of the elements detected by the algorithm is 
less than a maximal width. 

11. (Original) The process set forth in claim 9, step b) further comprising 
the following steps: 

m) interpolating the low-resolution segmentation results on the original 
resolution of the image; 

n) if any local background is segmented and if any object is classified as a 
picture object, refining the borders of each local background and each picture 
object; and 

o) if any object is classified as a text object, refining the borders and interior 
of each text object. 
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1 2. (Original) The process set forth in claim 1 1 , step n) further comprising 
the following steps: 

p) applying a region growing algorithm to each of the pixels along the borders 
of each local background and each picture object, wherein adjacent pixels with a 
color difference from the region less than a predetermined threshold are marked as 
belonging to the region 

13. (Original) The process set forth in claim 1 1 , step o) further comprising 
the following steps: 

p) applying a region growing algorithm to each pixel along the border of each 
text object, wherein adjacent pixels with a color difference from the region less than 
a predetermined threshold are marked as belonging to the region; and 

q) applying a region growing algorithm to each pixel of each text object, 
wherein adjacent pixels with a color difference from the region less than a 
predetermined threshold are marked as belonging to the region. 

14. (Original) The process set forth in claim 11, further comprising the 
following steps: 

p) determining if the local background is a sweep; and 
q) if the local background is a sweep, reclassifying the composite object as a 
picture object. 

15. (Original) The process set forth in claim 14, step p) further comprising 
the following steps: 

r) dividing the local background into sub-regions, wherein the sub-regions are 
in a K x K arrangement; 

s) computing the mean color of each sub-region; 
- t) determining the maximal difference between the mean colors; 

u) comparing the maximal difference to a predetermined threshold; and 

v) if the maximal difference Js larger than the predetermined threshold, 
identifying the local background as a sweep. 

1 6. (Currently amended) A method for segmenting an image, comprising 
the following steps: 
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a) identifying a main background for the image; 

b) identifying a first object on the main background; 

c) classifying the first object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object; and 

d) if the first object is classified as a composite object, identifying a local 
background for the first object : and 

e) if the first object is classified as a composite object, identifying a second 
object on the local background . 

17. (Currently amended) The method set forth in claim 16, further 
comprising the following steps: 

o) if tho first object io c l aGs i ficd as a composite object, i dentifying a second 
object on tho l oca l background of tho fir s t object; 

f) classifying the second object into one class of a group of classes consisting 
of a text object, a picture object, and a composite object; and 

g) if the second object is classified as a composite object, identifying a local 
background for the second object. 

18. (Original) The method set forth in claim 17, further comprising the 
following steps: 

h) if the second object is classified as a composite object, identifying a third 
object on the local background of the second object; 

i) classifying the third object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object; and 

j) if the third object is classified as a composite object, identifying a local 
background for the third object. 

19. (Currently amended) The method set forth in claim 16, further 
comprising the following steps: 

ef) identifying a second object on the main background; 

fg) classifying the second object into one class of a group of classes 
consisting of a text object, a picture object, and a composite object; and 

§h) if the second object is classified as a composite object, identifying a local 
background for the second object. 
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20. (Currently amended) The method set forth in claim 19, further 
comprising the following steps: 

ib) jf the second object is classified as a composite object, identifying a third 
object on the local background of the second object; 

ji) classifying the third object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object; and 

kj) if the third object is classified as a composite object, identifying a local 
background for the third object. 

21. (Currently amended) A method for segmenting an image. The mothod 
sot forth in c l aim 16, further comprising the following steps: 

a) identifying a main background for the image; 

b) identifying a first object on the main background: 

c^ classifying the first object into one class of a group of classes consisting of 
a text object, a picture object, and a composite object: and 

d) if the first object is classified as a composite object, identifying a local 
background for the first object: 

e) if the first object is classified as a composite object, determining if the 
dimensions of the local background of the first object are greater than a 
predetermined threshold; and 

' f) if the dimensions are not greater than the predetermined threshold, 
reclassifying the first object as a picture object. 

22. (Currently amended) The method set forth in claim 16, further 
comprising the following steps: 

ef) if the first object is classified as a composite object, determining if the local 
background of the first object is a sweep; and 

fg) if the local background of the first object is a sweep, reclassifying the first 
object as a picture object. 
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